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This paper presents a new approach to distributed nonlinear control for formation 
acquisition and maintenance, inspired by recent results on cyclic topologies and based 
on tools from contraction theory. First, simple nonlinear control laws are derived to 
achieve global exponential convergence to basic symmetric formations. Next, conver- 
gence to more complex structures is obtained using control laws based on the idea of 
convergence primitives, linear combinations of basic control elements. All control laws 
use only local information and communication to achieve a desired global behavior. 

I. Introduction 

Multi-vehicle systems which achieve mission objectives by cooperatively controlling their relative 
positions have been widely studied in the distributed control literature pQ. Many applications 
require achieving a formation. Some of them can as well achieve the overall mission objective 
by converging to some manifold without a need to specifically track relative trajectories. These 
include, for example, fragmented telescopes, packs of chaser robots and space missions where only a 
structural shape of the formation is important like the Laser Interferomatric Space Antenna (LISA) 
mission. 

There are specific advantages in achieving a formation by using only local information, rather 
than a central coordinating mechanism. Especially, as the number of agents in the formation is 
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increased, combining the information of the whole formation to calculate the control commands 
becomes challenging. Thus, recent research has studied the emergence of a global behavior based 
on local rules [2, 3 . However, research on formation control has mostly focused on approaches that 
converge to fixed point trajectories by tracking fixed relative positions to neighboring agents. 

The most common approach to formation control studied in the literature defines laws based on 
tracking relative position to a set of neighbors, using a variety of methods to synthesize the controller, 
e.g. LQG, Hqo, etc. This approach is not always the most desirable, and the control effort can 
often be significantly reduced by eliminating the 'unnecessary' constraints in the formation degrees 
of freedom, and converging instead to desired manifolds defined by linear or nonlinear constraints. 
Additionally, if the emergent behavior is an overall geometric state with some unconstrained degrees 
of freedom, a leader or a pair of leaders can control those states for the whole formation without 
the need of a global coordination mechanism reassigning relative position targets. 

Some authors have studied the convergence to relevant symmetric formations by using potential 
functions, e.g. [H|5]. A main pitfall in that case is convergence to local equilibria, leading to a lack of 
global convergence guarantees and unpredictability of the behavior under disturbances, with these 
difficulties exacerbated in the time- varying case. Guaranteed global convergence to formation, in 
itself a highly desirable property, also has important implications in the robustness of the formation 
architecture. 

In this paper a new approach to distributed formation acquisition and maintainance with global 
guarantees is discussed. By contrast to more explicit control techniques, this approach does not 
specify fixed points trajectories for the formation. Rather, it allows the agents to achieve a formation 
under specified structural constraints and provides an approach to deriving sufficient conditions for 
global convergence. The approach produces global convergence results for nonlinear control laws 
and combinations of cyclic grids that achieve complex formations while maintaining the global 
convergence guarantees. 

The control algorithms are inspired as a generalization of the cyclic pursuit control laws recently 
presented by Pavone and Frazolli [6] and extended by Ren [7] which converge to rotating forma- 
tions. The analysis, based on contraction theory [8, 9J, yields global convergence results and direct 
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extensions for nonlinear systems and more general dynamic cases. It also allows the introduction 
of convergence primitives, where control laws consist of combinations of simpler control laws, and 
constraints in the desired configuration are described as convergence subspaces and combined to 
achieve more complex formations. 

Since the main objective of the article is the introduction to the system analysis approach, the 
focus is on simple integrator dynamics, but also illustrate implementation of the control algorithms 
for higher order dynamic systems. 

Section |TT] defines the notation and some mathematical tools and background of the theoretical 
approach. Section |ITT| introduces the contraction theory approach to the problem and its relations to 
the previous literature. Section |TV| derives control laws for global convergence to regular polygonal 
formations and presents a result for global convergence to a regular formation of specific size. 
Section [V] introduces convergence results based on control primitives, which are presented through 
applications in Section |VI| Brief concluding remarks are presented in Section |VII| 

II. Background 

In this section, definitions and results from matrix theory that used in the derivation of the 
article's results are provided. 

A. Notation 

Let M >0 and R> denote the positive and nonnegative real numbers, respectively, and denote 
as K(x) the real part(s) of the complex element x. Let j = \J — 1 and /„ denote the identity matrix 
of size n; A T and A* denote, respectively, the transpose and the conjugate transpose of a matrix 
A. A block diagonal matrix with block diagonal entries Ai is denoted diag[A;]. For an n x n 
matrix A. let eig(A) denote the set of eigenvalues of A, and we refer to its fcth eigenvalue as Xk(A). 
\ ma x(A + A T ) > \ k (A + A T ) for all k and correspondingly X min (A) : X mm (A + A T ) < X k (A + A T ). 
In general, a matrix A(x,t) is positive definite if A m i„(^4(x, t)) > 0, and it is denoted as A > 0, 
equivalently negative definiteness an positive semidefiniteness are defined and respectively denoted 
A < 0, A > 0. The state of a single agent i is denoted by which in general Xj e R 3 and the 
overall state of the system will be denoted as x = [xf , xj, . . . , x^] T . 
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Definition II. 1 Flow-invariant manifolds 

A flow invariant manifold M of a system x = /(x) is a manifold such that if x(i Q ) G M. then 
x(i > t ) € A4. We are interested in flow invariant manifolds that can described as the nulls-pace of 
a smooth operator, x e M => V(x, t) = 0, ^(V(x, t)) = 0. 

B. Kronecker Product 

Let A and B be m x n and px q matrices, respectively. Then, the Kronecker product A <g) B of 
A and -B is the mp x nq matrix 

/ \ 

a\\B . . . a\ n B 

A®B= : : 

^a m \B . . . a mn B j 

If \a is an eigenvalue of A with associated eigenvector va and A_b is an eigenvector of B with 
associated eigenvector v>b, then Xa^b is an eigenvalue of A®B with associated eigenvector va®vb- 
Moreover: (^4 ® B){C ® D) = AC ® B_D, where A, B, C and _D are matrices with appropriate 
dimensions. 

C. Rotation Matrices 

A rotation matrix is a real square matrix whose transpose is equal to its inverse and whose 
determinant is +1. The eigenvalues of a rotation matrix in two dimensions are e ±: > a , where a is 
the magnitude of the rotation. The eigenvalues of a rotation matrix in three dimensions are 1 and 
e ±:,Q! , where a is the magnitude of the rotation about the rotation axis; for a rotation about the 
axis (0,0, 1) T , the corresponding eigenvectors are (0, 0, 1) T , (1, +j, 0) T (1, — j, 0) T . We denote R(a) 
or R a a rotation matrix of angle a. 
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D. Circulant Matrices 

A circulant matrix C is an n x n matrix having the form 



/ \ 

C Ci C 2 . . . Cn-1 



C = 



Cn-l C Ci 



Cl 



Cl c 2 c 



(1) 



The elements of each row of C are identical to those of the previous row, but are shifted one position 
to the right and wrapped around. The following theorem summarizes some of the properties of 
circulant matrices. 

Theorem II. 2 (Adapted from Theorem 7 in [10J ) Every n x n circulant matrix C has eigen- 
vectors 



J )k = J_( 1 e 2Kjk/n^ e 27rjfc(n-l)/n> T 

\ n \ 



ke {0,l,...,n-l}, 



(2) 



and corresponding eigenvalues 



n-l 



(3) 



p=0 



and can be expressed in the form C = UAU* , where U is a unitary matrix whose k-th column is 
the eigenvector ip^, and A is the diagonal matrix whose diagonal elements are the corresponding 
eigenvalues. Moreover, let C and B be n x n circulant matrices with eigenvalues {^B,k}k=i an d 
{•^C,fc}fe = i; respectively; then, 

1. C and B commute, that is, CB = BC , and CB is also a circulant matrix with eigenvalues 
eig(CB)= {A c , fe A B , fe }£ =1 ; 

2. C + B is a circulant matrix with eigenvalues eig(C + B) = {Xc.k + ^B,k}k=i- 



From Theorem |II.2| all circulant matrices share the same eigenvectors, and the same matrix U 
diagonalizes all circulant matrices. 



E. Block Rotational-Circulant Matrices 

The set of matrices that can be written as L ® R where L is a circulant matrix and R is a 
rotation matrix about a fixed axis all belong to a group of matrices that we denote as C1Z. The set 
C1Z forms a conmutative matrix algebra, since the eigenvectors of L are the same for all circulant L 
following Section |II B| and the eigenvectors of R are the same for all rotation matrix R that share 
an axis of rotation. 

F. Contraction theory 

The basic contraction theory analysis tool is the result derived in jS], which we state here in a 
simplified form. 

Theorem II. 3 Contraction |8j 

Consider the deterministic system in M. n : 

i = f(x,t) (4) 

where f is a smooth nonlinear function. Denote the Jacobian matrix off with respect to x by 
If there exists an invertible square matrix 0(x, t), such that the matrix: 



F = e^e- 1 (5) 

ax 



is uniformly negative definite, then all the system's trajectories converge exponentially to a single 
trajectory. The system is said to be contracting. 

An important corollary of this approach is the definition of auxiliary systems which have as particular 
solutions the trajectories of the system being analyzed. Proving that the auxiliary (or virtual) system 
is contracting shows that the system of interest converges to trajectories of the auxiliary system. 
This is the principle of partial contraction analysis [5], which in particular leads to the following 
theorem. 
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Theorem II. 4 Partial contraction 

Consider a flow-invariant subspace M., and the associated orthonormal projection matrix V onto the 
orthogonal subspace M. . All trajectories of system (Mj converge exponentially to M. if the system 



y = vf(v T y ,t) 



(6) 



is contracting. 

In this paper, as in the flow-invariant linear subspace Ai will typically represent some synchro- 
nized behavior. The result also extends to certain types of nonlinear manifolds. 



First, we frame the decentralized convergence to formation and point out some of the differences 
in the structure of the approach to the more general approach. 

Consider a basic distributed control law that converge to a formation of vehicles to a regular 
formation equally phased from each other. Using the most common neighbor differences approach, 
which in a generalized way is [12J: 



The agents converge to fixed point trajectories of states defined by the time functions xj(t) — 
Xi(t) = h.ij(t) which are to be agreed upon. The approach presented by Chung et al. [T3] uses 
contraction theory to show the convergence to a synchronized formation. In that approach, the 
vehicles synchronize their trajectories by tracking phase-separated trajectories and in essence their 
approach generalize a consensus approach for Lagrangian systems. 

Another approach consists on defining the desired geometry of the formation as the stationary 
points of gradient based laws of potential function [HEHIS]. This control approach however, lacks 
global convergence guaranties. If the information graph is not rigid, such approaches can converge 
to several different equilibria. 



III. Contraction theory approach to formation control 




(7) 
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In a different manner, control laws based on the cyclic pursuit approach [B]: 

±i = = fci?(a)(x i+ i - Xi) (8) 

globally converge to circular formations and do not require to specify (and agreee upon) fixed 
trajectories of the states. This allows for degrees of freedom in the formation to be unconstrained, 
which leads to a reduction in the control effort. The convergence properties of the cyclic pursuit 
law have been presented in previous work and several extensions have also been discussed [16]. 

In a more general sense, in this paper we propose an approach to analyse the convergence 
properties of systems of the type: 

= /(x) + u 4 
u.( = y"^j(x,£)(xj -m) 

i 

by defining invariant manifolds to which convergence is to be shown and using the results from 
partial contraction theory to show the convergence properties. 

As an introduction to the contraction theory approach, consider the relation to a case presented 
in the context of contraction theory in the work of Pham and Slotine In the context of 

contraction theory they presented an example which shows some relation to the cyclic pursuit 
algorithm. Specifically, the example in sec. 5.3 in |11] analyzes a system of three coupled nonlinear 
oscillators: 

xi = /(xi) + fc(i?(27r/3)x 2 - xi)) 

x 2 = /(x 2 ) + k(R(2n/3)x 3 - x 2 )) (9) 
x 3 - /(x 3 ) + fc(i*(27r/3)xi - x 3 )) 

where R(a) is a rotation matrix for an angle a and studies its convergence to the flow-invariant 
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manifold: 



M = <x = 



i?(^f)x T , i?(f)x T x 1 



,x e 



(10) 



Now, considering a first order system with a basic cyclic pursuit control law in eq. 



Xj = = f(xi) - kR(a)(x l+1 - x t ) 

> x = diag[/(xj)] - (fcLi <g> i?(a))x = diag[/(x;)] - £ 3 x 



(11) 



where L\ is the cyclic Laplacian: 



1 -1 ... 



1 -1 ... 



Li 



V 



-10 



V 



(12) 



and M. is an invariant set of diag[/(xi)], i.e. diag[/(ii)] = for all x £ M.. 

Analyzing the case of 3 nodes as well, the most obvious approach would be to consider the 
same invariant manifold in eq. |10| The calculation of the contaction properties to such manifold 
show an inconclusive result though, as the corresponding Jacobian of the dynamics of y = V^l is 
only negative semi-definite. Instead, consider a different flow-invariant subspace, namely, the set of 
regular n-polygon formations with origin anywhere in the plane: 



M n = {x : (xj + i - Xj) = i?2^(x l+2 - Xj+i)}, \fi < n - 1 



(13) 



where R a — R(a). Ai n describe a manifold of all the states where the vehicles are in a regular 
polygon formation as shown in figure [l] Notice that M C M n . 
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Fig. 1 Constraint description of Mi 

M n can be shown to be a flow-invariant manifold for the cyclic pursuit law: 

Xj+i-Xi = fl(a)(x i+2 -x i+l )-i?fe(x i+ i-x i ) 

= i?a2L-R(a)(x 4+ 3 - x i+2 ) - i?i2Li?(a)(x i+2 - x i+1 ) 

Xj+l-Xj = i?2ir (x. i+2 - X i+ i) 

A matrix V rn , such that V^. n x = 0^x6 A4 n is: 



^-7 Z + i?2. -R2, ... ^ 



-7 7 + i?2x -i?^ 



In the case of 3 vehicles, with a = n/3, V r 3 corresponds to: 



V, 



-10 3/2 V3/2 -1/2 — 



r3 



-1 — s/3/2 3/2 V3/2 -1/2 
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and the projected Jacobian is: 



v r3 c 3 v r T 3 = 



( 6 3^ 
1 3V3 6 j 



> (17) 



which from Theorem |II.4| verifies the global convergence of system in eq. [TT] to manifold Jv[ n if 
A mnl (V r 3 df j^ ) < 6. Similar results are also found for more than three vehicles and in the 
next section we show a generalized result for any number of vehicles and more complex cyclic 
interconnections under state and time varying coupling matrices i?(x, t) . 

IV. Cyclic controllers for convergence to formation 
A. Generalized cyclic approach to formation control 

Theoretical results for the convergence to symmetric formations based on control laws that 
generalize the cyclic pursuit algorithm to more general interconnections and nonlinear cases are 
presented in this section. First we show the global convergence of a basic control law to regular 
polygons under a generalized nonlinear cyclic topology with any number of vehicles and then we 
show how this result directly verifies the global convergence to rotating circular formations in the 
case of the basic cyclic pursuit algorithm. 

This control law generalizes the results and allows for the design of distributed algorithms that 
converge to formations with geometric characteristics that depend on a common coordination state, 
and can be time varying. One can think for example a satellite formation that expands, contracts 
(by varying a) or speeds up (by varying k) as a function of its location in orbit. 

Consider the first order system x = /(x) + u and the generalized symmetric cyclic control law: 

Ui(x,t) = ^ fc ™( X '*) (i?m(x,f)(x [l+m] -Xj) + i?,], (x, t) (x[ 4 _ m] -Xj)) (18) 
meAfr 

where Af r is a set of relative neighbors in the ordered set {1, .., N}, and [p] <E {1, .., N} indicates p 



modulo N. The expression in eq. ( 18 1 indicated that for each link {i, [i + m]} there is a symmetric 
link {i, [i — m]}. fc m (x, t) € M>o is a gain and R(x,t) is a coupling matrix that can be selected to 
achieve different behaviors. A general description of the overall dynamics of a system can then be 

11 




Fig. 2 Different cyclic topologies 



writen as: 



x = f(x)-^k m (x,t)((L m ®R m (x,t) + L] n ®Rj n {x,t)))x 

m 

= f (X) - fc ™( X ' *)0Cm(x, *) + £ m( X ' *)) X 



(19) 



and let us define: 



£ sro (x,f) = (£ m (x,t)+£T(x,t)) 



(20) 



where x is the vector describing the overall state of the system and L m are m-circulant Laplacian 
matrices describing cyclic underlying topologies with interconnections to each m-other agent as 
shown in fig. [2] 

Now, consider the manifold M n , presented in section [Till 



M„ = {x : (x i+ i - Xj) = i?2x (x l+2 - X{ + i)} = {x : V rn x = 0}, 



(21) 



which can be shown (straightforward from eq. ( 14 1 ) to be a flow-invariant manifold of the dynamic 
system x = fe(x, i)(£ sm (x, i))x. 
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Note that V rn can be written for the general case of n vehicles in 3D as: 

V rn = (W®h)(I n ®R n )((L 1 ®R„ /N ) + (Lj®lg /N ))±W n Tl v CW (22) 

with W — [/n-3|03n— 3]) -^1 i s a cyclic Laplacian for a 1-circulant topology and R v is a rotation 
matrix for any value r\. 

Since V rn is full row rank, there exists an invertible transformation V rn = TV rn such that if 
V rn A(V rn ) T > then V rn AVj n > 0, where the columns of V rn are a set of orthonormal basis such 
that V rn (V rn ) T = I. Then, following the results of partial contraction theory described in sec 
we have that if: 

W n TZ n C^ - ^A: m (x,t)£ sm (x,^ (C^^K^Wj < uniformly (23) 



III 



then, the system converges to M. n . 



HE 



the cal- 



Since 72-„, C^ N \ £ sm (x,i) e C1Z, following the result in sec 
culation of the eigenvalues of their product and correspondingly verifying that 
W n n ri C^ N \Y, m k rn{^,t)^ S rn(yi)){^ N) ) T n^Wj l < uniformly is straightforward and is 
shown in appendix [X] The results are applied in the following theorem: 

Theorem IV. 1 Distributed nonlinear approach for global convergence to symmetric 
formations 



Consider the distributed system with a generalized cyclic topology, using control law in eq. (18) 



x, = f(x) + u;(x,t) (24) 
u i( x ^) = ^2 fcm(x,t)(i?(a m (x,i))(x [l+m ] - x,) + R(-a m (-x.,t))(x[i_ m ] - Xj)) (25) 



for which a description of the overall dynamics is written as: 



x = f (x) - ^ fcm(x, t)£ sm (x, t)x (26) 
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x is the vector describing the overall state, x is a particular regular polygonal state, and V rn f(x) = 0. 
Then, if: 



- jnia 4 M-cos f^-J j y^fc m (p,t) (cos (ga m (p, i))-cos |ga m (p,t)- —^—j ) } (! 



(27) 



<je{-iAi} v 

/or some 77, i/ie system globally converges to a regular polygon. 

Specifically, i/f(x) = the system globally converges to a regular polygon formation if: 



swp} y fc m (p,t)(cos(ga m (p,t)) - cos(ga m (p, t) -2irrm/N)) > (28) 
p.t 



Vg£{-l,0,l}, ie{2 1 N-l}. 

Proof: For a regular formation V rn ~x. = 0, V rn C srn (5c, i)x = 0, then V r „(f(x) — 
fc m £ srrl (x, t)x) = 0, therefore A4„ is an invariant manifold of the system. 

it is also true that A{7?X^ m k m (x,t)£ sm (x,t)£ T lZ T } > 
If KCXCK < 0, then W^rXCT^Wj < for any ma- 



From the results in Section 



A.l 



min i<i<jv \ik defined in eq. A.l 
?e{-i,o,i} 

trix X. 

Thus, if condition in eq. (27) is satisfied, then V rn ( df g^ — ^2 m k m {x.,t)C sm {x.,t) rn )Vj n < and 



therefore x exponentially converges to x € M. n - □ 
If f(x) = 0, the above conditions in f(x) are satisfied and the global convergence to V rn x = 
is verified for specific combinations of fc m (x, t), a m (x,i). For the case of a 1-circulant topology L\, 
if k(x,t) > and |a(x, t)\ < 2n/N, convergence to A4 n , i.e. a symmetric formation is guaranteed. 

Remark IV. 2 The Laplacian £ sm (x, t) is the symmetric part of the Laplacian £ m (x, t) = L m <g> R. 
From the properties of positive negative matrices VAV T < iff V(A + A T )V T < 0. 

It was shown that the manifold A4 n is an invariant manifold of the cyclic pursuit control 
law i?(a)(xr i+rrl ] — Xi), then, verifying the conditions for convergence for the symmetric control 
law u = fc m (x, t)(£ m (x, <) + £ m (x, £) T )x is a direct proof of convergence to circular rotat- 
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ing formations for the directed topology u = k m (x, t)C m (x, t)x, witt asymmetric control law 
U, = fc m (x, i)i?(a)(x[ i+m ] — Xj) generalizing the results for cyclic pursuit. 

This last result verifies the convergence to rotating regular formations resulting for k 7 a constants, 
agreeing with the results obtained through linear analysis presented in [51 171 H5]. 

Proposition IV. 3 For a ring topology (L\), if \a\ = tt/N, the formation converges to a regular 
polygon with a constant size 

Proof: When a symmetric configuration is achieved: 



x i+m - Xi = i?(-27rm/iV)(Xj - Xi_ m ) (29) 



Then 



u 4 = R(7r/N)(x i+1 -x i ) + R(-Tr/N)(x i _ 1 -x i ) 

= R(n/N)(R(-2n/N)( Xl - Xj_i)) + R(-ir/N)(xi-i - x t ) 

= i2(-7r/JV)(xi - Xi _i) + ii(-7r/iV)(x^_i - x.) - 0. (30) 

□ 

Similarly, for a more general cyclic topology with state and/or time dependent parameters k and a, 
the condition for k m (x, t), a m (x, t) to achieve a regular polygon with fixed size is given by: 

Ui = fc m (x, t)(R(a m (x, t))(R(-2mn/N)(x, U - x, fy- m i)) 

+i?(-o; m (x,i))(x,t[ j _ Tri ] - x,i,)) = 
= J2 k rnfrt)(R(am(x,t)-2%m/N)-R(-a m {x,t))) =0 (31) 

m 

B. Distributed global convergence to a desired formation size 

The previous section addresses the problem of converging to a formation under a general cyclic 
interconnection. However, the subspace to which convergence is defined allows for the size of the 
formation to be an uncontrolled state of the system. In general the problem of global convergence 
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to a splay-state formation using only neighbor information has been sought after in the literature. 
As mentioned in the introduction, this article considers the approach to a formation without con- 
straining the relative states to be a specified vector. 

One approach that converges to formations without specifying fixed relative vectors in a global 
frame consists of using structural potential functions [3] . When using only relative magnitude infor- 
mation, if the interconnection is not a rigid graph, the global convergence to the desired formation 
is impossible due to the ambiguity of the possible equilibrium configurations. An extra piece of in- 
formation, allows the approach discussed in this paper achieving global convergence results, namely, 
the agreement on an orientation which in the case of spacecraft flight can be achieved by individual 
star trackers. In the case of the cyclic pursuit, an approach similar to the one presented in previous 
work |16| , where the angle of the formation is defined as a dynamic variable that depends on the 
relative distance to the neighbor seems a reasonable approach however, the stability results are only 
local. 

In this section, using an extension to the approach in the previous section we present a dis- 
tributed control law for which global convergence to the desired size can be guaranteed. Specifically, 
a sufficient condition in the magnitude of an arbitrary function is determined to guarantee conver- 
gence to the desired formation from any initial conditions. 

The overall structure of the proof consists of first showing that a sufficient condition on the 
bounds of an arbitrary odd function f(x) guarantees convergence to a symmetric formation, i.e. 
convergence to the invariant manifold M n . And then, to show that the trajectories within that 
manifold lead to a formation of the desired size. 

Theorem IV. 4 Global convergence to a regular formation of a desired size 

Consider a set of agents with first order dynamics Xj = u i; interconnected under an undirected 
cyclic topology with control law: 

Ui = i?„/ W (x i+ i - Xj) + i?^ /A r(xi_i - Xj) + /(|x i+ i - Xj| - p)(x i+1 - Xj) (32) 

where f(z) is an arbitrary bounded odd function of z, such that zf(z) > for z ^ and /(0) = 0. 
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The overall dynamics can be written as: 



x = (-£, + G(x))x 



(33) 



Global convergence to Ai np , the manifold of regular formations with intervehicle distance p, x G 
■M-np = {x : V rn X = 0, |Xj — Xj\ = p yi,j} is guaranteed if: 



^min{Vm£s(Vm) ) ^/maa;^max(^rn^l(K'n) ) 



(34) 



where V rn is the matrix of orthonormal bases for V rn , C s is the symmetric circulant rotational 

-I I 

and f(x) < f r , 



Laplacian, A\ is the matrix A\ 







Proof: To start, consider the following two lemmas: 



Lemma IV. 5 The manifold A4 n is a flow-invariant manifold of the dynamics in eq. (33) 



Proof: It has been shown that A4 n is an invariant manifold of C s , namely V rn C s 5i = for x 
such that V rn x = 0. For a regular formation |x^. + i — x^.| = |x,; + i — Xj| then /(|xfc + i — x^l — p) ~ 
/(|xj +1 — Xj| — p). and thus without any loss of generality G(x) = (/(|x 2 — Xi|)Li ® /s)x. 

Then, V rn {-£ s + G(x))x = /(|x 2 - x 1 |)y rn (L 1 ® I 3 )x = 0. □ 

Lemma IV.6 eig{V rn A ls Vj n ) = eig{V rn A ks Vj n ) for all i, k € {1, . . . , N}, where A ls = {Ai + Aj). 
Ai = <X> I3, — {a^j} G M. NxN is a matrix of zeros except the elements afj = —1, a'\- +1 = 1. 
Ai was explicitly described above. 

Proof: eig^mAisV^) = eig(V rn AksV^) if and only if there exists a similarity transformation 
such that: 



TVmAisVj^ — V rn Ak s V^ n T 



(35) 



Notice that T ik Ai = A k T k i where T ik — T^ = (I n — Lk-i) ® h, for example, in the case of 
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i = l,k = 2: 



10 

1 

1 ... 



-I I 





T 12 Aj = A 2 T& 


-I I 




0.../ 
7 0... 
I ... 



(36) 



(37) 



and correspondingly Ti k Ai S — A ks Tki- Then we have that V rn Vj n = I, therefore by defining 



T = V rn TV? n : 



TV rn Ai S V rn — V rn TV rn V rn Ai S V rn — V rn T Ai S V rn 



(38) 



and 



V rn A ks VlT = V rn A ks vJ n V rn TVJ n = V rn A ks TVj n , 



(39) 



showing the desired equivalence. □ 
Based on the above two lemmas, we can then show that condition ( |34[ ) guarantees convergence to 
the invariant manifold A4 n . Specifically, invoking the results in [3] and introduced in Section 



III 



the convergence to the manifold M. n : {x : V rn x.} is guaranteed if the projected Laplacian of the 



auxiliary system y = (— C s + G(x))y is negative definite, i.e. 



V rn (-£. + G(x))VZ<0 



(40) 



This can be guaranteed if 



(V rn C s V r T n ) > \ max (V rn G{x)Vj n ) 



(41) 
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Since 



^max (l / rnG(x) (V rn ) ) — ^max 

(=1 

(F r „^(x)(V; n ) T ) (43) 



eq. (34 1 guarantees eq. (40 I and thus, convergence to A4 n . 

Now, it is shown that convergence to M. n implies convergence to M. np . Having that £x = 
then, the dynamics of the distance between any two vehicles in A4 n are given by: 

— |x i+ i-Xi| = ^ ^-(Xi+i-Xi) 

ill |Xj + i-Xj| 

/(|Xj +2 - X l+ l| - p)(x l+2 - X 4+ l) - /(|X. 1+ 1 - Xj| - p)(x. i+ l - Xi) 
(/(l x i+l - x »l - P)-R27r/iv(Xi+l - Xj) - /(|x i+a - X»| - p)(x i+ i - Xj) 
(/(l x *+l - x *l - P){R2iz/N ~ h)(Xi+l - Xj) 

= - cos(7r/AT)/(|x i+1 -Xi| -p)|xi+i -Xi| (44) 
defining z = |x i+1 - Xj| - p: 



( x m - 


x,) T 




- Xj| 




x,) T 


- 


- Xi| 


- 


x,) T 


- 


- Xj| 




x,) T 


l x i+l - 


" X;| 



i = -coB(n/N)f(z)(z + p). (45) 



A Lyapunov function candidate for this system is V — lz 2 , yielding 



V = -cos(ir/N)zf(z)(z + p) (46) 



Since f(z) is an odd function, zf(z) > for z ^ 0. Furthermore, z + p = |x»+i — Xj| > 0, so that 



V < 0. Using Lasalle's Invariant Set Theorem [17_, the system (33 1 globally converges to the largest 
invariant set where V = 0, namely M. np . □ 
Note that the global guarantee in this control approach is defined by an upper bound on the arbi- 
trary function f(z). This bound is easily implementable by a saturation function or an arctangent 
function. 
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The two results presented in this section generalize results of cyclic control approach to non- 
linear systems. Specifically, an analysis approach that achieves global guarantees for a generalized 
version of cyclic pursuit is introduced, which includes time-varying and state-dependent gains and 
coupling matrices as well as more general cyclic interconnections. Additionally, we introduce a de- 
centralized control approach with global convergence guarantees to a regular formation of specified 
size, described by upper bounds on a function that defines the separation between vehicles. 

C. Extension to second order systems 

In the derivation of the results we define the systems as first order systems. In this section an 
approach based on a sliding mode control is presented, which shows an straighforward extension of 
the first order integrators to more complex dynamics. 

Let Xj(i) = [xi t i(t), Xi_ 2 {t), x ij3 (i)] T £ M. 3 be the position at time t > of the ith agent, 
% e {1,2,. . . ,n}, and let x = [xj ,xj , . . . ,x^] T . 

Consider a linear first order system: 




(47) 



shown to converge to manifold M \ . 



If the dynamics of each agent are now described by a second order model: 



v 4 = f(xi,Vi 



(48) 



consider the feedback control law: 



/(xj,Vi) + k d ^Aij^j - Xj) + A ij(vj - V,) - k d w, L , k d e M> - 



(49) 
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A useful form to describe the second order system is by using the sliding variables: 



Si = fcrfXj + Vj (50) 



Then, the dynamics of the overall system (48 1 with control law (49 1 can be writen as: 



Xi = A ^( k d{^ 3 ~ Xj) + (Vj - Vj)) - fctfV; 

= Aij((k d Xj + Vj) - (k d Xi + Vj)) - fc d Vi 



Then, the system dynamics are described by the equations: 

^ = ^2Aij(Sj -s^ (51) 
Xj = -fc d Xj + Si (52) 

The first equation describes a first order system for which global convergence to a manifold M. C R 3 
can be analysed following the approach in the previous sections, the second equation is an stable 
first order filter with input s 4 and output x^. Then, the trajectories of the agents under control law 



(49 1 are the filtered response of trajectories of the first order system. 

Under the control law in eq. (H9j), the physical trajectories converge to trajectories which are 
just the response of the filter Gk d (ju) — to the trajectories of the first order system with 

initial conditions s(0) = fcrfx(O) + x(0). 



V. Convergence Primitives 

An approach to formation control based on combination of primitives is described in this section. 
This approach is an extension of theorem |II.4| Using the idea of primitives, controllers that converge 
to more complex subspaces can be designed and their global convergence properties verified. 

Theorem V.l Consider the system: 

x = ^f l (x) 
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such that: 



Vi 



Vifi(x)=0, Kx = 0, ViceM 



wii/i rank(Vi) = Pi. 
Then, if either: 



i.) 



(53) 



or, 



ii. 



Vn rfx V l V n dx V 2 



where span{V T } = span{[V^~V^~ ...V^]}- The 



\ 



T 



V^V 
v 2 dx "r, 



Vn dx V n J 



< 



x e as t -> oo 



(54) 



Proof: For the first condition consider x, a particular solution such that = V£x = V^x = 
= K,x. Since V is full row rank, there exists a linear transformation V = TV where V is an 



orthonormal partition of R™ and TV AV T 1 < <S> V"A^ 1 < 0. Then, if condition (53 1 holds, the 



system y = Vx is contracting with respect to y and any trajectory of the system y converges to 
the same solution, namely x — ► x G ^MiVi) — f). Mi. 
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For the second sufficient condition, consider the auxiliary system: 



( \ 

yi 
y-i 



y = 



Vo 



V nJ \V nJ 



(55) 



then: 



k 



(56) 



where Vi are orthonormal projections of the state such that VTV^ — I Pi , and V^Vi + UjUi = I n . 
The Jacobian of the system y with respect to y is: 



V^Vj 



Vn^W V^Vj 



1 1 dx v n 



y dUyT 
Vn dx V n 



Since rank(Vi) — Pi, Vi —T^Vi where Tj is an invertible matrix, it can be writen as: 



diag [Tj] 



K l dx V l V l dx V 2 



Vn dx V 1 V n dy . V 2 



vl dx y n 
1 dx n 



y dUy^ . 
Vn dx v n f 



diag[Tj] 



and diag[Tj] is an invertible transformation, such that TVAV T T T < if and only if V T AV T < 0. 



Then, the negative definiteness in eq. (54), proves the global convergence to y = 0, i.e x — > x € 

fW(y,) = n 4 M:. □ 

Notice that additionally, if y^fi(x)T^ T < then V J2i Wc^i( x )^ T * s a ^ least semidefinite 
negative. If one of the summation terms is positive definite or if the summation is full rank, it is 
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positive definite. 

Corollary V.2 Consider a set of N agents with dynamics x, = Ui grouped in sets S s s G 
{m, n, nm}, and a set of control laws u m = / m (x), u„ = /„(x), u mn = / mn (x) corresponding to each 
group where / s (x) depends only on elements of set S s and has corresponding invariant manifolds 
M s corresponding to the set of transformations V s , for which V s f s = 0. Control law f m interconnect 
agents in set S m G S, control law f n interconnect agents in the set S n G S, S m n S n = 0, and control 
law fnm interconnect agents in set S n and S m . 

If f s , individually converge to their invariant subspaces M s , i.e. V s ^Vj < for all i, then, 
a sufficient condition for the global convergence of the system x = ^ s / s (x) to the subspace M = 
is: 



1 v k %v? ^ + £>^ 



> 



for all k,l G s. This result can be extended to more than two sets of disjoint groups n,m with 
interconnecting links nm. 

Proof: Since g m (~l g n = 0, V n f m — 0, the Jacobian has a block tridiagonal structure: 



y df^nyT y dj^ayT 



o 



2x " m ' m dvi ml 
y l 4Sm L yT y df m i yT y ,*T/T 

IZ&T/T 



V 



o 



yShmyi 

1 dx ir. 





y fjfnp yT y CyT 



J 



given the block tridiagonal structure the positive definiteness result can be verified by verifying the 
positive definiteness of lower dimensional matrices following the following proposition. □ 
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Proposition V.3 A block tridiagonal matrix with positive block entries Ai 







A X 2 








\ 

\ 




A„, 


■^22 


4„„ 
^-23 


n 

u ... 


n 
u 


A = 





A 3 2 


^33 


A34 







I 







A nn _i 


A 

-^71,71 I 



and An > 0, A nn > 0, is positive definite if the submatrices 



( \ 

An 2Ai 



> 



2Ai+i t i Ai + i^ + i j 

Proof: by partitioning the space as x = [xi X2 ... x n ], the quadratic form is: 



x T Ax = xf Anxi + xf (A12 + Aj 1 )x 2 + x^ A22X2 + xj (A23 + Aj 2 )x2 + X3 A33X3 + . . ■ 

= -Xi AllXl + -X^Axi + x\ {A\2 + Aj l )x 2 + \x%A 2 2X2 + -X2 A%2X2 +■■■ + -X^Ax v 



1 T A 1 

—xi Ax\ H — 

2 1 2 



1 xi I An 2A12 » 

V7 



y2A 2 i A22 j 



xi x 2 



1 


r V 

2:2 


( A 

A 2 2 


2A 23 ^ 


2 


W 


V 2A 32 


A33 , 



2:2 x 3 



(57) 



x n Ax n 



□ 



which is positive if condition in eq. (57 1 is met. 

In the next section, we illustrate the application of the results in this section with a series 
of examples where application of the theorem and the discussed corollaries give insight into the 
construction of different convergence mechanisms. 



VI. Examples 

In a first example we present a useful application of the analysis approach to define a decen- 
tralized control algorithm based on a set of primitives whose global convergence properties can be 
verified from the results of theorem IV. 11 
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Example VI. 1 Global convergence to formation with only relative information Consider 
a group of 8 agents Xj, i G {1, ..N}, and a control law: 



u i = ki(Rt(t)(xi + i-TCi) + Rj(t)(xi- 1 -x i )) for i G S t 



(58) 



with agent groups defined as S± = {1, 2, 3, 4}, £2 = {3,4, 5,6}, £3 = {5,6,7,8}, and where 
R-K/i(t) G M. 3x3 is a rotation matrix that by switching its rotation axis can switch the orienta- 
tion of the formation. (The switching rate should be slow enough compared to the convergence rate 
to allow for the formation to convege to a fixed subspace before switching). Namely, the rotation 
matrices can be defined as R[ = T;(t)i? W/ / 4 T ; T (t), where 7\ is a constant arbitrary direction matrix 
(we can assume T\ = I without loss of generality): 



To 



( \ 
10 



1 
0-1 



Ti 



^0 cos(0) — sin(0)^ 



sin(^) cos((/>) 

1 



Ti 



And the subspace constraints are: 



V l = [Vniln^Tx) 6x6 

^2 = fo 6x3 V rA (I n <g> Tu) o ()X , 

6x6 V ri {I n ®T 2 ) 



From theorem \ V. 1\ a numerical verification of the global convergence and stability to the specific 
subspace, namely a cube formation with a face pointing at a given direction defined by <f>, is posible. 
Figure^ shows a simulation of the dynamics the formation converging to a cubic formation. At t = 
15, transformaion T whitches and the orientation of the formation changes. The global orientation 
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Fig. 3 Sequence of snapshots agents converge to a cube in 3D and rotate. Trajectory time 
history below 



state of the formation is controlled by a parameter change in only 4 of the vehicles. 

Another example that illustrates the application to derive convergence properties for general 
cooperative control problems consists of studying a formation of vehicles surrounding a target: 

Example VI. 2 A regular formation surrounding an (un)cooperative target Consider a 
system of n + 1 agents, n of them with dynamics as in eq. |j<S| ), and a leader agent with state x\ 
that uses information from all others and/or all other agents use information from it: 



*i = / p (xi,x) 

±i = R(Xi+l - Xi) + i? T (Xi_! - Xj) + / c (Xj - Xi) 
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i = {2. ..,n}, and some general fucntions f c ,f P /c(0) = 0. Denote x = {x2,X3, . . . ,x„}. The overall 
dynamics can then be written as: 









{ 



/p(xi,x) 
\C s x + f c (x,xx) 



We are interested to determine convergence to the subspace defined by V£ = 0, where: 



V = 



( o v rn \ 



nl -1 



where 1„ £ M" is a vector of ones, \nli —1^<E)I] is a projection matrix into a subspace where the 
target is in the center of the formation and V rn is the projection to the subspace of regular polygons 



in eg. (15). Considering the following results: 



£,(ln®l) = 0, 

V rn -^[l n ®I] = 
ax 



We find that: 



ydFy-T 



V C V T 4- V ^V T 



'rn'-'S v rn 



,l dx V rn 



dxi dx 



o 

■)+n 2 ( 



cixi 



dx 



Then, if < 0, a sufficient condition to surround the target is: 



V(^-^) + n(^-^)<0 
z — 1 cfaq dxi dxi dxi 



A^oie f/ia£ f c , f p are arbitrary functions and the result gives a sufficient condition to achieve the 
mission objective in terms only of the gradients of f p and f c . 

In the next example an example that can be applied to a fragmented aperture system is con- 
sidered, where individual telescopes are deployed in an arbitrary configuration and the objective 
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consists on achieving convergence to a formation where in its final configuration the vehicles are 
as close as possible to each while maintaining a minimum separation between them to achieve the 
recreation of a full aperture composed by many small segments. The problem is related to the 
two-dimensional sphere packing problem and a solution can be described by a series of concentric 
hexagonal formations. In this example, a distributed control law based on theorem |V.1| is proposed 
and sufficient conditions for global converge to such configuration with any number of spacecraft 
are derived. 

Example VI. 3 Convergence to a packed formation. Consider a set of agents with first order 
dynamics x$ = Ui, grouped in M sets Si of 6 vehicles, and consider the input: 

Ui = i? 7r/6 (x i+ i - Xj) + flj /6 (xi_! - Xj)f m for i e S m 

S m being a group of size 6, m € {1, ...,M}. This input was shown to make the system of agents 
x,j, i € Si converge to manifold A4 e : {Vg x = 0} °f regular hexagonal formations. 
Now, consider interconnection control laws between the different sets Si: 

Ufe = -Rr^Xfe+i - x fc ) + i?J /3 (x fe _i - x fe ) = f mi for keS m i; (59) 

S m i being a group with 3 agents, some agents in S m and some in Si, which has been shown to 
converge to triangular formations such that : {V r 3X = 0}. 

The constraints of the desired convergence subspace are V m = [V r e (UxeL Vi = [O^xe Vrs], and 
the corresponding link constraints V m i — [vi, . . . , Ujy], v n € M 3x3 ; v m i = —I,, v m 2 = I + i?27r/3> 
vii = — i?27r/3 for some ml,m2 G S m , 11 £ Si. 

The Jacobians will be denoted as ^ = Ag. 

Then, from theorem \ V.l\ and corollary ] V. 2\ showing global convergence to a grid defined by a pair 
of concentric, aligned hexagonal patterns S m and Si with three-agent link interconnections between 
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them S m i, requires showing that: 



( V m A m vZ V m {A ml + Aj n )Vj^\ ( V r6 £f } V r T 6 



V m (A ml + Al)Vj d 

[y ml (A m + Al l )vZ v ml A ml v^ ) \v ml {A m + Al ll )vZ v 3 d 3) v 3 T ) 



> 



and, 



[V^a + Aj^ 



ViAiV? 



I 



IT Wt\ 



V r3 C ( s 3) V r T 3 V ml (Ai + Aj nl )V t 
\yi{A ml +Aj)V^ v 6 ci 6 \ T J 



> 



(60) 



where = L®R + L T ®R T , with L e R nxn . 

This result directly verifies global convergence for any number of rings with corresponding in- 
terconnecting links, and overall global convergence of the system is guaranteed by the result in eq. 

Figure ^] shows snapshots of a a simultion of the dynamics of an example of the convergence 
for such a controller in a scheme with three hexagonal rings. Agents in S\ = {1, ...,6}, S 2 
i 7. . . . , 12} 53 = {13, . . . , 18} converge to hexagonal formations. Formations S12 — {1, 7, 2}, S12 = 
{5,4, 10},iSi3 = {6, 17, 12},5i3 = {3,4,9}, establish links that define a manifold A4 = f^\Mi corre- 
sponding to a regular sphere packing grid. 

We close this section by presenting an example with a result guaranteing global convergence to 
a desired size of formation when the size is commanded by one of the spacecraft using only relative 
information to its neighbor(s). 

Example VI. 4 Leader based convergence to desired size. In this example we consider a 



system of n agents with a control law (18) and a leader that controls its separation to other agents 
by a control law f r (d): 



u t = R(7r/N)(x l+1 -x t ) + R(TT/N) T {x^ 1 ^x l ) i = 2,3..N (61) 
mi = R(a)(x 2 — xi) + R(a) T (xn — xi) + f r (\\x 2 — xi\\ 2 — p)(x2 — xi) (62) 
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Fig. 4 Agents converge to a packed grid by imposing some convergence constrains shown by 
the arrows. T=10s, 90s, 250s, 350s 



where f r (p) is a positive function of p with equilibrium point such that / r (0) = 0. Then, the system 
exponentially converges to a symmetric formation with interagent separation p. 

Proof: The principle of the proof is to show that the dynamics of an auxiliary system y = V(x) 
are contracting, and y — is a particular solution of the system. Thus y tends to zero. 

Consider, the overall dynamics of the system of single integrators with control law \61\ : 



x = -£ s x + / r (x)A lX (63) 



where C s is the Laplacian defined in previous section which converges to regular formations and 
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-4, 







Consider the auxiliary variables 



( \ 






yi 






w 







(64) 



where V T V + U T U = I, C s U T Ux — 0, which define an nonlinear invariant manifold A4 np : 
{x | Vx = 0, / r (x) = 0}, since x = for x G A4 r . Their dynamics are given by: 





/ 








V 




/ 








V 



Vx 



( 



V(-C s x + y 2 A 1 x) 



-vc s v T y^ix 

-(V x / r )£ s F T (V x /r)^lX 











/ 





f(x,y) 



(65) 



XVie auxiliary system (65) is contracting and all trajectories will converge to the same trajectory if: 



df 

F = 6 — 9" 1 < 



Specifically y = is a solution, then, any trajectory of system (65) converges to y = 0, which means 



that any solution of (63) converges to x G M n p 



V and V rn are related through an invertible transfomation V = TV rn , and consider an invertible 

(io\ 



transformation that commutes with T, i.e 



, where 9 > G R. Then, 



V° 7 



re^e -1 ^ = qt^-t^q- 1 < o & f < o 
ay ay 



Then, a sufficient condition for convergence of system (63) to a regular formation with charac 
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teristic size p is: 



( 

V 



-v rn c s v r T n e- l v rn A^ 

0(V x f r )£ s V r J n (V x / r )A lX 



< 



(66) 



We have shown that V rn C s Vj n < 0, and we also have that: 



V rn AiX. ■ 



(x 2 - x\) = D±{x 2 - x\) 



V x / r = 2(x 2 *i) T ^ [I I . • .0] = 2^(x 2 - Xl ) T D 2 



Then, the projected Jacobian J y is negative definite iff: 



(V xfr )A^ = -2(x 2 -x i r^ El - 

dp 



< 



dfr(p) 
dp 



> 



(67) 



and (from a Schur factorization): 



(v x / r )^ix+ i(^-V™A 1 x-e((v x /o^Kl))(Knr s v;I)- 1 i(e-V rn A 1 x-e((v x / r )r s v;I)) T < o 



(,1-o-rjL) j D 1 -26 2 ^-D^j (VmCsVZr 1 (D 1 - 26 2 ^D) (x 2 - Xl ) 



(d, - 2e 2 ^D^j (V^Kl)- 1 (d, - 26 2 ^-D 



<-26 2d ^I 



dp 



D = D 2 C s Vj n , verifying that the negative definiteness of J y does not depend on the value o/x. If for 
a particular value o/x, a constant transformation 6 is found which verifies the negative definiteness 
it holds uniformly. 

Then, the satifaction of the two above conditions is sufficient to guarantee convergence in terms 
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of 



f. For example, for f - = 1, N = 5, 6 



, verifies global convergence to any desired 



V 



0.5 



7 



size of formation. 



□ 



VII. Concluding remarks 



A new approach to formation control has been presented by using the tools of contraction theory. 

The advantage of this approach include global convergence to formations defined by constraints 

of the desired state and not trajectory points. Further research would consider linear or afhne 

transformation for convergence to not only regular formations, and the use of the convergence 

primitive tools to define more complex convergence states. Additionally, extending the results to 

a time varying manifold, seems a feasible straightforward extension. We will consider tests of the 

algorithms in the SPHERES testbed in the microgravity environment of the ISS. 
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APPENDIX A: EIGENVALUES OF THE PROJECTED LAPLACIAN 

The derivation of the eigenvalues of TZ n £^ £ m (a)(£^ N ^) T TZ^ ( denoted here lZ££ sm £ T lZ T for 
brevity of notation) uses the properties of block-circulant matrices, specifically, the fact that they 
all belong to a commutative algebra. We have that: 

eig[n££ sm £ T n T } - eig[^ T ]eig[£( Ar )]eig[(£( Ar )) T ]eig[£( a )+£ T ( a )] 
= eig[(I n ®R{Tr/N)){I n ®R T (w/N))} 

xeig[(L 1 ® I 3 )(Lj ® 7 3 )]eig[r(a) + £(a) T ] 
= eig[(Li ® I 3 )(Lj ® J 3 )]eig[£(a) + £(a) T ] 
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Then, 

\ lk *e{i,..,JV},fce {-1,0,1} 

^ _ e -j2imir/N^^ _ e j2imir /N^^jka _ e pka-j2imn/N^ _|_ ^jka _ e -jka+j2in/N^ 

(2 - e ~ i2i *t N - e j2l7T/N )2(cos(ka) - cos(ka - 2irmr/N)) 

4(1 - cos(2in/N))(cos(ka) - cos(fca - 2irmr/N)) (Al) 

Then, for i = 1: (1 - cos(2i7r/A)) =0 A u = 

for z = A: (cos(fca) — cos(/ca — 2min/N)) = =>■ Ajvfc = 

otherwise for 1 < i < N, \a\ < 2ir/N : 

(cos(fca) — cos(fca — 2imir/N)) > 
(1 - cos(2i7r/A0) > 



eig[K££ sm £ T K T ] = 

Ait = 



Proposition A.l 

v rn c sm vj n = w n n v cc sm { a )c T n^w^ > o , (A2) 

Proof: lZ££ sm £ T lZ T is a symmetric matrix, then, its nullity is the algebraic multiplicity 
of the eigenvalue. Thus, dim{J^(TZ££ sm £ T TZ T )} = 6. On the other hand, the dimension of 
W n (n££ sm £ T n T )Wj = 3N - 6, and thus it is full rank. Since (R v ££ sm {a)£ r 1lJ- l ) is positive 
semidefinite, then V rn £ sm Vj n is at least positive semidefinite, but since it is full rank, the proposition 
is proven. □ 
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